Building Ensembles with Heterogeneous Models
نویسندگان
چکیده
In the context of ensemble learning for regression problems, we study the effect of building ensembles from different model classes. Tests on real and simulated data sets show that this approach can improve model accuracy compared to ensembles from a single model class.
منابع مشابه
Learning to Assemble Classifiers via Genetic Programming
This article introduces a novel approach for building heterogeneous ensembles based on genetic programming (GP). Ensemble learning is a paradigm that aims at combining individual classifiers outputs to improve their performance. Commonly, classifiers outputs are combined by a weighted sum or a voting strategy. However, linear fusion functions may not effectively exploit individual models’ redun...
متن کاملA Multi-Agent System to Assist with Property Valuation Using Heterogeneous Ensembles of Fuzzy Models
The multi-agent system for real estate appraisals MAREA was extended to include aggregating agents, which are equipped with heuristic optimization algorithms and can create heterogeneous ensemble models, was presented in the paper. The major part of the study was devoted to investigate the predictive accuracy of heterogeneous ensembles comprising fuzzy models and to compare them with homogenous...
متن کاملHeterogeneous Ensemble Classification
The problem of multi-class classification is explored using heterogeneous ensemble classifiers. Heterogeneous ensembles classifiers are defined as ensembles, or sets, of classifier models created using more than one type of classification algorithm. For example, the outputs of decision tree classifiers could be combined with the outputs of support vector machines (SVM) to create a heterogeneous...
متن کاملEvaluation of Neural Network Ensemble Approach to Predict from a Data Stream
We have recently worked out a method for building reliable predictive models from a data stream of real estate transactions which applies the ensembles of genetic fuzzy systems and neural networks. The method consists in building models over the chunks of a data stream determined by a sliding time window and enlarging gradually an ensemble by models generated in the course of time. The aged mod...
متن کاملClassifier Ensembles for Changing Environments
We consider strategies for building classifier ensembles for non-stationary environments where the classification task changes during the operation of the ensemble. Individual classifier models capable of online learning are reviewed. The concept of “forgetting” is discussed. Online ensembles and strategies suitable for changing environments are summarized.
متن کامل